Hybrid training of optical neural networks
نویسندگان
چکیده
Optical neural networks are emerging as a promising type of machine learning hardware capable energy-efficient, parallel computation. Today’s optical mainly developed to perform inference after in silico training on digital simulators. However, various physical imperfections that cannot be accurately modeled may lead the notorious “reality gap” between simulator and system. To address this challenge, we demonstrate hybrid where weight matrix is trained with neuron activation functions computed optically via forward propagation through network. We examine efficacy three different networks: an linear classifier, opto-electronic network, complex-valued study comparative training, our results show robust against kinds static noise. Our platform-agnostic scheme can applied wide variety networks, work paves way towards advanced all-optical intelligence.
منابع مشابه
Training Neural Networks with GA Hybrid Algorithms
Training neural networks is a complex task of great importance in the supervised learning field of research. In this work we tackle this problem with five algorithms, and try to offer a set of results that could hopefully foster future comparisons by following a kind of standard evaluation of the results (the Prechelt approach). To achieve our goal of studying in the same paper population based...
متن کاملHybrid interior point training of modular neural networks
Modular neural networks use a single gating neuron to select the outputs of a collection of agent neurons. Expectation-maximization (EM) algorithms provide one way of training modular neural networks to approximate non-linear functionals. This paper introduces a hybrid interior-point (HIP) algorithm for training modular networks. The HIP algorithm combines an interior-point linear programming (...
متن کاملTraining Artificial Neural Networks by a Hybrid PSO-CS Algorithm
Presenting a satisfactory and efficient training algorithm for artificial neural networks (ANN) has been a challenging task in the supervised learning area. Particle swarm optimization (PSO) is one of the most widely used algorithms due to its simplicity of implementation and fast convergence speed. On the other hand, Cuckoo Search (CS) algorithm has been proven to have a good ability for findi...
متن کاملEstimation of Industrial Production Costs, Using Regression Analysis, Neural Networks or Hybrid Neural - Regression Method?
Estimation (Forecasting) of industrial production costs is one of the most important factor affecting decisions in the highly competitive markets. Thus, accuracy of the estimation is highly desirable. Hibrid Regression Neural Network is an approach proposed in this paper to obtain better fitness in comparison with Regression Analysis and the Neural Network methods. Comparing the estimated resul...
متن کاملTraining Large Neural Networks
We describe regularization tools for training large-scale artiicial feed-forward neural networks. We propose algorithms that explicitly use a sequence of Tikhonov regularized nonlinear least squares problems. For large-scale problems, methods using new special purpose automatic diierentiation are used in a conjugate gradient method for computing a truncated Gauss-Newton search direction. The al...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Optica
سال: 2022
ISSN: ['2334-2536']
DOI: https://doi.org/10.1364/optica.456108